This AI deepfake is next level: Control expressions & motion
HTML-код
- Опубликовано: 27 июл 2024
- LivePortrait tutorial: Free, opensource AI deepfake tool for animating 1 photo. It can even handle tricky expressions & movements
#aitools #aivideo #deepfake #ainews #ai #agi #singularity
TurboType is a Chrome extension that helps you type faster with keyboard shortcuts. Try it today - they have a FREE forever plan.
www.turbotype.app/
Live Portrait:
liveportrait.github.io/
github.com/KwaiVGI/LivePortrait
Newsletter: aisearch.substack.com/
Find AI tools & jobs: ai-search.io/
Support: ko-fi.com/aisearch
Here's my equipment, in case you're wondering:
Dell Precision 5690 www.dell.com/en-us/dt/ai-tech...
GPU: Nvidia RTX 5000 Ada nvda.ws/3zfqGqS
Mouse/Keyboard: ALOGIC Echelon bit.ly/alogic-echelon
Mic: Shure SM7B amzn.to/3DErjt1
Audio interface: Scarlett Solo amzn.to/3qELMeu
0:00 Scope and examples
6:25 Installation
7:20 Git
8:18 Installation (continued)
9:19 Conda
12:12 Installation (continued)
15:37 Running LivePortrait 
Наука
TurboType is a Chrome extension that helps you type faster with keyboard shortcuts. Try it today and start saving time. They have a free forever plan!
www.turbotype.app/
Thanks man, amazing video and I will try this hkey manager.
Lowkey one of the best AI youtubers
Free and open source? No such thing. If it was so, installing it wouldn't be needed. Double click and it would work.
@@laylasmart lmao nonsense
@@minhuang8848
Harvesting info is the goal today. For that Microsoft made Copilot AI and Recall. A spyware within the operating system.
How soon can I get a Hogwarts painting of my dead grandmother to tell me to wash my hands every hour?
Now, if you want
First thing I think of is a potential VR application. This would be in real time , your whole expression would be projected on your VR avatar.
It looks like it still takes some processing time to run the software, so at least currently you couldn't animate an avatar in real time on a local recording. So for V-tubers, at least a few months off. But if it's run by a cloud service, maybe they could make it work.
It's not new, Meta has already demo'd this type of realtime avatar . Zuck showed it off on Lex Friedman's podcast.
It's realtime and very high quality , just requires some pre-processing of a full face scan
@@iankrasnow5383 with the speed of tech innovations in the last few years, if they decide to work toward this it won't be that long
video calling
@@iankrasnow5383 A lot of time. Still not a consumer friendly implementation. Might take some more time to be realtime ready. Fingers crossed.
I subscribed to you when you had 2K subscribers, and today you have 150K. Bro, you totally deserve it, and your content is worth much more than 150K. Soon you will reach 1M. Love you bro, from India ❤
i normally dont mess with this stuff until there is an involved interface, super excited for this stuff to be working open source
you're right. For reasons I could not fathom, very few AI tool were pushed to the point where they get a user friendly client like Midjourney. Even programmer like me struggles to pull a repository from git and build it up myself, I don't think any reguar artist out there can do AI without at least a client side.
@@SVAFnemesis what, you don't like typing in Discord? heretic.
@@English_Lessons_Pre-Int_Interm can you please carefully read and understand my comment.
always appreciate you show every single steps to install. It's very helpful for person who is not familiar with any codes
my pleasure!
This is probably the best instructional video I have seen lately. Going thru the steps in great detail. Thank you for that.!! Once installed it runs smoothly.
You're very welcome!
were you able to run it on a group photo to animate multiple faces? i was unable to
@@abhishekpatwal8576 you can uncheck do crop and it does try but the result isnt there yet
how do i create a file like exe to just open it up later? i could use it first time but when i closed the tap and cmd i wasnt able to open again...
You could create a .bat instead and run commands there.
Maybe auto-py-to-exe
This is insanely fantastic for controlling expressions keep making your great videos.💯Top Notch.😁
thanks!
Thanks! It's absoluetly awesome as nodes in comfyUI!
oh, is there a node for this already?
@@theAIsearch Yup ^^
What happens if the source sticks out a tongue?
The entire internet crashes.
there are already artifacts with the teeth where it stays static as the hair is with the background, i'd imagine the same will happen with the tongue.
huuuge step up for open-source nonetheless!
Harambe is resurrected
doesnt work
What is bro planning to do
Wow, you always present great advances in AI, and open source, I am very grateful for your channel, I will try this soon
Thanks!
Very thorough tutorial and a very good project to cover!
Thanks!
wow, the option to animate a face on a source video has a great potential. I can already see people creating scenes of people interacting with each other with Runway Gen-3 or another video generator and then editing the video so that the people in the scene actually talk!
We're one step closer to creating movie scenes.
exactly!
Am I missing something. I don't have the option to use a source video to animate as the input only an image option. Is that a different program than this?
@@user-cz9bl6jp8b I don't know. I never tried it. I was only commenting on what I saw in the video.
@@user-cz9bl6jp8b I'd like to know this too.
Create a source video from the movie "The Mask". When Jim's character becomes freaky with his eyes and mouth.
love your videos, keep up the good work :D
Thanks!
Wow, great stuff. This is the next step I was waiting for. All the puzzle pieces are falling together... moving characters and then making them talk or sing. It just all needs to come together in one platform to combine different features to create movies or music videos or virtual avatars. Thanks for sharing! EDIT: Can you make this work with 16:9 ratio images? I see a lot of lip-sync programs that are just square.
I just want to say you are the best, thx a lot dude
i've been using this from beta on starting about 3 years ago. their current version is proprietary and does so much more and mimics lifelike in every way.
I could fix the lip sync of the Teenage Mutant Ninja Turtles movie with this!
I can think of a hundred ways to use this creatively but i have only got 4GB VRAM.
@@eccentricballad9039 Use Google colab👀
You mean the original 1990 movie? Never noticed
The 1990 movie is ace! You can correct espeially the 3rd one! ;)
Working on a cartoon about a mischeivous young girl named Yumi, I've been using AI since the beginning and finally found a way to make her consistently with apps that effectively use Character Reference techniques, I've even trained a model with my character. Being a creative partner with Pika, Leonardo AI, and finally Runway ML I am able to create a ton of content, but I will need to add the character animation, and while I actually turned my AI character into a fully rigged Metahuman, it's nice to know if and when I need a quick shot and don't have the time to set it up in Unreal, I can quicky generate my character in the scene, then I or my niece, who will do most of the performance stuff for Yumi, can act out and voice her and I can use that footage and audio to animate the clip. This is an amazing time to be in. As someone who uses AI as a tool, I can see the several use cases for stuff like this, and it's going to make life easier for me as I am a studio of one and I have zero budget to make most of my stuff. So using a combination of free tools and my natural resourcefulness I am starting to make head way. The one man film studio era is here now.
I am right alongside you brother!
can you give a short list as to how you would go for character consistency with free tools? i found it to be either lacking extremely (wasnt consistent) or its payed models i couldnt try.
example:
1. Ai x: its free and has no tokens, i use it to do this and that. then i can you this is step 2 for ..
2. AI x2: also free and has no tokens, now you can...
We really need more post from you, we are bored without you
thanks
Thank you. Excellent Video, very detailed and well explained. New subscriber
Thanks!
Thanks to your very detailed patient step by step instruction, I was able to generate my own live portraits.
My results are not as perfect as the examples, but amazing nonetheless. Thank you! Thank you! Thank you!
I need to recant and say that everything worked out in the end. It is necessary to install all the components first, and only at the end of it all can you install the platform. Thanks for the video.
glad you got it to work!
which py version did you use ?
@@User-Mtw-j4n What I did was follow the tutorial in this video and after four or five failed attempts it ended up working.
Man this seems insane. I love your findings. Will test it tonight!
Just one thing! If you could add the timer or how long it took to process that would be very much appreciated 🙏
Thanks. For a 10s video, it took maybe 1-2min to generate. Very quick compared to other tools
@@theAIsearch thank you very much! That’s waaay faster than I expected! 🤯
This is going to be so great for video editing instead of having to animate facial animations for characters we could just use this software
yes!
what do you recommend for animation software
YOU ARE REALLY GIVING ME ALL THESE THINGS whenever I NEEDED THIS TO Make my animation!!!!
Nice can I see your animation when you're finished?
Good luck!
@@theAIsearch how to run on amd gpu
It looks weird in motion, but if u pause the expressions at any point during its animation, it looks good and natural.
Incredible! Thanks for sharing!
no problem
Absolutely incredible!
yes!
Thx man the ad was smooth
😃
Can you make a video on your hardware? That setup you have looks cool
THIS IS INSANE... All wanna be yahoo boys from Nigeria Say Hi. Your work is so easy now haha
thats crazy! i wanted to create a yt channel for so long but didnt want to use my own voice nor face. i can do it now :)
That's a great idea Good luck to you and your channel! Did you need a Chinese phone number to run this app?
@monday304 LivePortrait doesn't require any number
Thanks for the update 😊
No problem
Very cool, thank you for sharing ❤
Too bad it won't work on VIDEOS or Multiple Faces like in their examples.
This is awesome. AI is really advancing fast.
The cat chopping chicken was awesome!
Amazing feature 🤩Greatly appreciate doing this super simple video guide on how to use this tool. Game changer! Thanks so muchhhh
enjoy!
Exciting functionality! I’m gonna do a deep scan with some security tools like wireshark n such. I suggest y’all do the same just in case. There are quite a few repos with zero day backdoors that specifically target windows. Happy prompting y’all
You are guiding like a god. Thanks for instructions
no problem
Great info! TY
Part of the webui is a file (frpc_windows_amd64_v0.2) which is a reverse proxy utility. Looks extremely untrustworthy to me. Running under a virtual environment mitigates some of the risk but I'm still skeptical. You should really be running this in an extremely sandboxed operating system.
China + open source + free = I'm gonna steal your life now.
@@kirtisozgur yeah, pretty much
Thanks for sharing!
I also noticed when you add a video it says "uploading video" which seemed a little sus for a local install.
Never trust a Chinese company that wants your data
It's works very well when the source photo and input video are at the same angle but there is obvious warping when the angle is different. Best to keep the angles the same.
Thanks for sharing
insane use cases are coming
The numa numa songs are gonna upgrade with this
This is gonna be a nightmare soon enough ...
Yea - one of my favourite (and somewhat fringe) concepts is that "Everything comes true in the end" - because the context around it changes.
My fav example of this is "primitive tribes in 1970s National Geographic Magazine" being afraid of cameras because they thought they could steal your soul.
Well.
Here we are. We are within days of there being a browser extension that with a single click can superimpose any photo into any porn video.... to take any youtube video of anyone and turn it into a kind of voodoo doll or gollum than can be made to perform any action imaginable, including ringing up your family, friends, enemies and doing such a perfect impersonation of you that it is actually more realistic than you are yourself.
In a way, the Algos already have voodoo dolls of you... a lifetime of clicks and comments etc, rows in a database tied by a single user_id.
I think "Text" was a massive massive revolution in what it meant to be human because it collapsed the time dimension. Memories became something that took zero energy to maintain. I think AI is a process towards collapsing some other dimension, although I've yet to figure out what it is, and I might of course be talking bollocks.
@@nicktaylor5264 i want what youre having
@@nicktaylor5264 Beautifully written, I too need my overlord my one true leader, a god not to worship but to follow, the basilisk, one of our own making.
@@nicktaylor5264☠️☠️☠️
Sure, if you have no idea about tech. This AI is amazing and it's only gonna get better.
Bro, good continuation would be to explain how to use it - vid to vid. Can you explain this? I saw examples when guys making vid to vid using liveportait and this is awesome
Dell and Nvidia huh? Were one of those your Chinese friends that gave you the code :D
Amazing demo! What are the potential security implications of using AI deepfake technology like Live Portrait? Are there measures in place to prevent misuse?
It's very interesting, I think I'll try it
Very cool. Imagine watching a foreign movie and the lips move like the ones from the translation. Or a video game sequence
That's it, I'm never ever gonna believe what I see online or on digital media anymore.
only left to make this all in real time and in holographic, thank you for the video and beginner friendly
that would be cool!
I have a basic laptop without the NVidia graphic card, can I use this as well?
Great demo! Curious as to your CPU / GPU / ram configuration that you ran this on?
Thanks. RTX 5000 ada, 16g vram. cpu is intel i7, but i dont think that matters
TurboType is great! was looking for something like that.
Btw, Your input files are very small. How long does it take to render? Can we change a 1080p video that is of 30seconds? the input would be around 100mb
Amazing walkthrough! Thank you! I'm having an issue where the output video bobbles around and shakes a bit. I'm not seeing this in your examples. Any ideas on why or how a shake is happening on the output?
▬ When the image is still it works fine. When it zooms out or zooms out you can already see that the image gets smaller and larger hahaha
Really amazing, thanks AI Search for this informations
Welcome!
This turorial was great. Thanks. Question: Is there any tool (like this to run locally) to upload an mp3 voiceover and generate the mouth and eye movements to later use in this process? Thanks!
yes, is this what you're looking for? ruclips.net/video/rlnjcRP4oVc/видео.html
I've seen tons and tons of songs with these, I think even during pandemic LOL. I didn't know it was this accessible.
At 3:58 you start talking about how you can use live portrait on not just stationary images, but moving videos too. Then in none of the examples at the end did you show how to use it on videos. I have tried uploading video but they are not a supported format.
What is going on?
Interresting, thank you
You're welcome
4:13 This is what I need. I could make 3D human and skip the whole facial expression rig. Just use a face capture footage to guide it.
Best channel 🔥🔥🔥
Thanks!
24:50 More impressively it also does the shadow in a believable fashion.
Finally one that works for macOS
I love that you walk through the installation. Thank you!
you're welcome!
Available in pinokio?
Looks amazing, we've got some Skynet advances in AI going on here...
I look forward to seeing the Remasters of Star Wars with it, along the the AI Audio, which is amazing.
I'd love to see AI fix Disney Star Wars: The last Jedi. Removing all the goofy stuff, I've already seen some great remasters of Alien Prometheus and Covenant, that are much better. The Alien stuff, just being regular talented people fixing them, not AI.
With AI, the film and series remasters are going to be truly amazing...
Live Portrait is wild wow
But it looked completely unnatural to only move the head. The shoulders stayed perfectly still throughout.
It's hilarious, scary, and amazing all at once.
That's good, but do you have any tools like this to animate hands and the rest of the body ?
I see this as weapon, not only a video editor
How long should it take? With a 3070 I'm at 1280 seconds of processing time. Wondering if it's actually processing or has stopped at this point.
Great stuff!
How long does it take to generate a 5 sec animation?
it depends on your gpu, but for me, less than 5min
Does it run from the cloud, or will this run offline? Is there a way to make a quick launch package to simplify it for the user?
Cool, and a big thumps up for it being open source and free. Not see how it is sustainable being free. Wonder when you can have whole body movement, objects involved and have multiple characters mimic different things in the same shoot and that interacts with eachother. But it is already impressing as it is.
I got a problem during entering the line "conda activate LivePortrait". It returns "CondaError: Run 'conda init' before 'conda activate'. What shall I do?
type this : conda init
it will ask you to close the cmd
then restart and do the same instructions
after that type : conda activate LivePortrait
@@bandaniji9061 Thank you! It worked. 🤝
@@PINKALIMBA Good to know
After the conda activate Liveportrait step. I get the following error:
ERROR: Could not install packages due to an OSError: [WinError 206] The filename or extension is too long: 'C:\\Users\\Dave\\Desktop\
oop-unleashed-main\
oop-unleashed-main\\installer\\installer_files\\conda\\envs\\LivePortrait\\Lib\\site-packages\\onnx\\backend\\test\\data\
ode\\test_averagepool_3d_dilations_large_count_include_pad_is_0_ceil_mode_is_False\\test_data_set_0'
I assume this is due to another program (roop-unleashed), any way of sorting this? Both folders (roop-unleashed and Liveportrait) are saved on the desktop.
Very very good... ⭐⭐
Does the app have to be installed on the same drive as miniconda? Cos I keep getting an error message: CondaError: Run 'conda init' before 'conda activate'
Great video! Just wondering how you do a video as source and a video as the driving, i only see image as the source option. If you can let us know. Thanks!
it will be released soon: github.com/KwaiVGI/LivePortrait/issues/27
The quality of the output is impressive.
were you able to run it on a group photo to animate multiple faces? i was unable to
@@abhishekpatwal8576 I didn't try that
This is really good, but 2d animation needs very specific training, you can't map a real person's facial movements to an anime character because it just doesn't look convincing. Either the real actor needs to move exactly like an anime character, or the model needs to be trained on anime movement.
amazing
Any idea why I am getting this error, everything else worked up until this point:
C:\Users\funky\Desktop\liveportrait\LivePortrait>conda create -n LivePortrait python==3.9
'conda' is not recognized as an internal or external command,
operable program or batch file.
I have the same issue
same issue here
this tech is good yet dangeruos at the same time
The video of a "girl rotating" at 4:10 is a Vermeer painting that someone has used AI to animate.
Just imagine how much impact it'll put on the movie industry.
That is INSANE! WOW!
😃
thanks for all your hard works, they are amazing, do you have a telegram channel for updates and news? i would love to join.
Thanks. I don't have any telegram channel at the moment
i use amd radeon graphics and seem this application cannot work in my device, please help
Those people who can create those type of application in code , why they don't create an installation exe type ?
because exe is a windows thingie, rest of the world uses a real unix operating system like mac and linux. ;)
Exactly this, i guess the people who can make this kind of stuff are just used to doing stuff the hard way.
A zipped .exe on a cloudstorage would have made this a no brainer.
Laziness.
There is this other program called chatgpt, I never used code or did any programming before but installed linux on an old computer as it takes up 90% less resources to run then windows and i just tell chatgpt what i want to do...copy command...paste command...and ive built custom personal apps somehow without knowing what im doing, if anything i just ask chatgpt or i copy and paste the output on the terminal and tell chat gpt to translate into english. If you have not yet experienced life apart from windows you will find that if you just jump out of that window and take a walk with the penguin into the rabbit hole there is a whole other world down there, vast and beautiful that is so free. If you take the plunge you will find the true meaning freedom in pc world and eventually come to the conclusion that you never knew that you have been locked up for so long behind that window that was preventing you from seeing what else is out there and all you had to do was open it and not be afraid to jump out. lol
There sure is money to be made by creating 'easy' installers for (would be) popular applications like this that comprise a lot of dependencies. But it'll be a lot of work and a totally different expertise than giving photos an animated face.
I know a few people that I wish I could set their Target Lip Open Ratio to zero. Just sayin'.
How about using Videos instead of Images as a source file. Just like the samples you show, please show us how we can do that as well, thanks. Anyway, I have successfully installed this in my computer using phyton only env. And u r right, it generate so fast unlike any other video generation like hallo which I have installed as well.
glad you got it to work. they will release the video feature soon github.com/KwaiVGI/LivePortrait/issues/27
There is a more awesome chinese AI that makes a 10 sec video out of an old photo. Giving life to the people, enviroment and the situation the people on the photos are in. giving them movements and interactions